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1.  SCOPE.  This  document  describes  methods  and  techniques  necessary  to 
perform  a  logistic  supportability  test  of  electronic,  avionic,  and  communi¬ 
cations  equipment  in  a  cold  regions  environment. 

2.  FACILITIES,  EQUIPMENT,  INSTRUMENTATION,  AND  SUPPORT  REQUIREMENTS. 


2.1  Facilities 


Characteristic 


Shops 


Minimum  Requirements 


Avionic/electronics  w/capability 
to  perform  maintenance  at  the 
organizational,  DS,  GS  levels. 


Approved  for  public  release;  distribution  unlimited. 
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Characteristic 

Office  and  administration  work  area. 
Calibration  shop. 

2.2  Equipment 
Item 

Standard  tool  set. 

Maintenance  support. 

Comparison  items 

2.3  Instrumentation 
Item 

Stop  watches 

Temperature  measuring  devices 
Anemometer 

2.4  References 


Minimum  Requirements 

Sufficient  to  accommodate  the 
test  team. 

Capable  of  calibrating  maintenance 
tools  and  test  equipment  furnished 
to  support  the  test  item. 


Minimum  Requirements 

Operator  level,  organizational,  and 
DS/GS  level  of  maintenance  author¬ 
ized  to  support  the  test  item. 

To  include:  Draft  publications, 
repair  parts,  accessories,  special 
and  common  tools,  support  and 
ground  handling  equipment,  multi¬ 
purpose  test  equipment. 

When  specified. 


Minimum  Requirements 

±0.1  second  (less  than  1%  error) 

±1°C  (±2°F) 

±2% 


2.4.1  Army  Regulation  70-10*,  Test  and  Evaluation  During  Development  and 
Acquisition  of  Materiel. 

2.4.2  Army  Regulation  200-22,  Environmental  Quality,  Environmental 
Effect  of  Army  Actions. 

2.4.3  Army  Regulation  385-163,  Systems  Safety  and  Engineering  Manage¬ 
ment. 

1 Footnote  numbers  match  those  in  appendix  E,  References. 
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2.4.4  AMC  Regulation  70-13,  w/TECOM  Supplement  14,  Test  and  Evaluation 
Incidents  Disclosed  During  Material  Testing. 

2.4.5  AMC  Regulation  70-8,  w/TECOM  Supplement  15,  AMC  Value  Engineering 
Program. 

2.4.6  FM  9-2076,  Operation  and  Maintenance  of  Ordnance  Materiel  in  Cold 
Weather. 

2.4.7  AMC  Regulation  700-15,  w/TECOM  Supplement  17,  Integrated  Logistic 
Support  Performance  Evaluation  Report. 

2.4.8  MIL-STD-14728,  Human  Engineering  Design  Criteria  for  Military 
Systems  Equipment  and  Facilities. 

2.4.9  Requirements  documents,  (LR,  LOA,  ROC,  Materiel  Needs,  etc.). 

2.4.10  TOP  1-1-0129,  Classification  of  Deficiencies  and  Shortcomings, 
w/Cl  and  C2. 

2.4.11  AR  70-3810,  Research,  Development,  Test,  and  Evaluation  of 
Materiel  for  Extreme  Climatic  Conditions. 

3.  PREPARATION  FOR  TEST. 


Facilities.  The  test  facilities  should  be  in  normal  operating  con- 
dition  with,  as  a  minimum,  those  maintenance  shops  required  to  keep  the  test 
item  and  support  equipment  equipped  and  functioning. 

3.2  Equipment.  The  initial  inspections  and  operational  checks  will  normal¬ 
ly  be  conducted  as  part  of  the  arrival  inspection  subtest  for  the  item. 
However,  project  personnel  must  insure  that,  as  a  minimum,  the  checks  out¬ 
lined  in  the  draft  equipment  publications  are  made.  When  a  reference  or 
comparison  item  is  used,  it  should  be  subjected  to  the  same  tests  as  those 
applied  to  the  test  item. 

3.3  Instrumentation.  Instrumentation  should  be  checked  for  accuracy  and 
calibrated  for  the  temperatures  at  which  it  will  be  used  prior  to  starting 
the  test. 

3.4  Data  Required.  Accurate  timing,  recording,  and  analysis  of  all  mainte- 
nance  actions  are  essential  in  determining  whether  the  maintenance  criteria 
for  the  test  item  are  met.  This  can  be  only  by  means  of  a  detailed,  accur¬ 
ate  data  collection  system. 

4.  TEST  CONTROLS  Maintenance  is  performed  as  appropriate  by  qualified 
personnel,  normally  military  with  appropriate  Military  Occupational  Special¬ 
ity  (MOS )  at  each  maintenance  level  (crew,  organizational,  direct  support, 
and  general  support)  as  specified  in  the  acquisition  plan  and  in  accordance 
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with  the  draft  maintenance  allocation  chart.  This  maintenance  will  be  con¬ 
ducted  using  the  tools,  test,  calibration  and  diagnostic  equipment,  and 
maintenance  shop  facilities  of  the  same  type  that  will  be  issued  to  the 
field  for  support  of  the  end  item  or  system. 

5.  PERFORMANCE  TEST.  Testing  of  Logistic  Supportabil ity  will  normally  be 
conducted  simultaneously  and  in  conjunction  with  other  test  operations. 
Separate,  independent  test  functions,  real  or  simulated,  will  be  performed 
as  required  to  insure  a  complete  exercise  of  all  the  logistic  supportabil ity 
aspects  of  the  test  system.  The  scope  of  the  logistic  supportabil ity 
testing  will  encompass  all  subelements  listed  below,  consistent  with  the 
availability  of  support  elements  and  the  maturity  of  the  test  hardware. 
These  data  should  be  delineated  in  the  detailed  test  plan. 

-  End  item  requirements 

-  Supply  support 

-  Technical  data/equipment  publications 

-  Support  and  test  equipment 

-  Manpower  and  personnel,  training,  and  training  devices 

-  Transportation  and  handling 

-  Facilities 

-  Stowage 

The  basic  subelements  may  be  further  subdivided  to  enhance  the  clarity  and 
understanding  of  an  individual  subtest.  Subelement  breakouts/divisions  are 
usually  dependent  upon  the  maturity  and  complexity  of  the  test  system  and 
test  constraints  (time,  dollars)  placed  on  the  test  effort.  Specific  cri¬ 
teria  for  each  subelement  test  must  be  extracted  from  program  documentation 
(requirements,  specifications,  purchase  description,  IEP/TDP,  etc.).  If 
specific  criteria  are  not  available,  they  may  be  generated  by  CRTC  and  will 
be  subject  to  confirmation  during  the  test  plan  approval  process.  Although 
the  logistic  supportabil  ity  test  is  subdivided,  the  evaluation  of  the  sub¬ 
elements  is  a  constant  overlapping  effort.  As  maintenance  and  repair  are 
being  performed,  manuals,  repair  parts,  tools,  test  measurement  and  diag¬ 
nostic  equipment  (TMDE),  and  the  adequacy  of  new  equipment  training  are 
continually  being  evaluated.  The  following  is  a  brief  explanation  of  each 
logistic  supportabil ity  test  subelement  listed  above  and  specific  guidance 
to  conduct  each  logistic  supportabil ity  subelement  test. 

5.1  End  Item  Requirements.  This  subelement  of  the  logistic  supportabil ity 
test  contains  a  quantitative  and  qualitative  analysis  of  maintainability  for 
the  test  system.  The  quantitative  analysis  will  quantify  the  logistic 
supportabil ity  through  calculation  of  the  maintainability  indices.  The 
qualitative  analysis  will  assess  the  overall  design  characteristics  for  good 
maintainability.  These  subtests  complement  each  other  and  provide  a  good 
insight  as  to  the  maintainability  of  the  test  item/ system. 
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5.1.1  Quantitative  Analysis  (Maintainability  Indices).  Unless  otherwise 
directed,  the  quantitative  analysis  will,  as  a  minimum,  reflect  the  follow¬ 
ing  logistic/maintainability  indices: 

-  Operational  availability  (Ao) 

-  Achieved  availability  (Aa) 

-  Inherent  availability  (Ai) 

-  Mean-time-to-repair  (MTTR)-Point  Estimate  at  each  maintenance 

level 

-  Maintenance  Ratio  (MR) 

Definitions  of  these  indices  have  been  taken  from  TECOM  Supplement  1  to  AMC 
Regulation  700-15'  and  are  presented  in  appendix  D. 

a.  Data  Required.  The  demonstrated  quantitative  measures  of  the 
logistic  supportability  are  recorded  within  this  subelement.  To  be  ident¬ 
ified  is  each  scheduled  and  unscheduled  maintenance  action.  Each  mainte¬ 
nance  action  must  be  carefully  assessed  and  accurately  documented  to  include 
the  following  essential  information  (see  end  of  maintenance  action  question¬ 
naire,  appendix  C). 

(1)  What  maintenance  tasks  were  performed  and  the  difficulties 
encountered  (if  any)  while  performing  the  maintenance  action.  Special 
emphasis  will  be  placed  on  performing  maintenance  outdoors  under  the  pre¬ 
vailing  weather  conditions  while  wearing  the  cold-dry  uniform. 

(2)  Record  of  what  necessitated  the  maintenance  action,  where  it 
was  performed  and  when  it  was  completed. 

(3)  Complete  description  of  the  maintenance  action. 

(4)  Identification  (model,  series,  serial  number,  etc.)  of  the 
system/subsystem/component  requiring  the  maintenance  action. 

(5)  Determination  as  to  whether  the  action  was  scheduled  or 
unscheduled. 

(6)  Classification  as  to  maintenance  category.  In  the  test 
arena,  this  classification  is  oftentimes  assessed  by  project  personnel 
knowledgeable  as  to  the  complexity  of  the  maintenance  action  and  the  Army 
maintenance  concept. 

(7)  Maintenance  timeline  correlating  number  of  personnel  required 
and  time  expended  on  each  maintenance  task  to  include  the  time  devoted  to 
troubleshooting,  active  maintenance  (repair),  and  logistics  delay  (supply, 
administration,  etc.). 

(8)  Service  time  (hours,  rounds,  miles,  cycles,  etc.)  accumulated 
on  the  test  item  when  the  maintenance  action  was  required. 
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(9)  Record  of  all  parts  which  were  repaired  or  replaced  and  POL 
products  replaced  due  to  contamination  or  consumption.  Parts  and  consum¬ 
ables  will  be  identified  by  noun  nomenclature,  national  stock  number  (NSN), 
functional  group  number,  and  part  number,  as  available. 

(10)  Whether  the  maintenance  action  was  performed  outdoors  under 
the  prevailing  weather  conditions  or  under  shelter. 

(11)  Air  temperatures  and  wind  chill  during  maintenance  action. 

(12)  Clothing  the  mechanics  were  wearing  during  the  maintenance 

action. 


(13)  Completed  the  supportabil ity  analysis  chart  in  accordance 
with  TECOM  Supplement  to  AMC  Regulation  700-15. 

b.  Analysis.  Based  on  the  data  recorded  in  paragraph  (1)  above, 
compute  the  maintainability  indices  presented  at  the  beginning  of  para  5.1.1 
as  required  by  the  Test  Design  Plan  (TDP)  and/or  other  controlling  docu¬ 
ments.  Indices  should  be  computed  for  the  primary  equipment  and  separately 
for  the  support  and  test  equipment.  All  values  used  in  computing  the 
indices  will  be  included  with  the  computations  in  the  test  report.  As  a 
minimum,  each  of  the  maintainability  indices  will  be  computed  in  accordance 
with  the  point  estimate  equations  presented  at  appendix  D  in  compliance  with 
TECOM  Supplement  1  to  AMC  Regulation  700-15  .  Determine  whether  the  test 
item  meets  the  maintainability  design  requirements  as  specified  by  the  re¬ 
quirements  document  or  other  established  criteria. 

5.1.2  Qualitative  Analysis  (Design  of  System  for  Maintainability).  This 
subtest  evaluates  maintainability  design  features  to  determine  if  the  design 
requirements  have  been  met.  Good  maintainability  design  features  will 
include: 


-  Modular  construction 

-  Ease  of  access  while  wearing  the  cold-dry  uniform 

-  Ease  of  access  to  batteries  and  adequacy  of  space  in  battery 
compartment 

-  Built-in  self- test  features 

-  Readily  accessible  test  points 

-  Mechanical  features  such  as:  Quick  connector,  built-in  work 
platform,  adequate  work  space,  protective  devices  (guards,  covers,  ground¬ 
ing,  etc). 


a.  Data  Required.  Evaluate  each  of  the  above  design  features  and 
make  an  assessment  whether  the  difficulty  Involved  and  time  needed  to  accom¬ 
plish  a  particular  maintenance  operation  are  excessive  based  on  experience 
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with  similar  equipment.  Safety  is  always  a  consideration  when  data  are 
collected. 

7  (1)  In  compliance  with  TECOM  Supplement  1  to  AMC  Regulation 

700-15,  comment  on  whether  the  test  item  is  designed  as  follows: 

(a)  To  minimize  maintenance  and  supply  requirements  through 
attainment  of  optimum  durability  and  service  life  of  materiel. 

(b)  To  eliminate  field  maintenance  problems  encountered  in 
earlier  design  items. 

(c)  For  ease  of  maintenance  while  wearing  the  cold-dry  uniform  by 
assuring  accessibility  to  facilitate  inspection,  repair,  and  replacement. 

(d)  For  maximum  interchangeability  of  components. 

(e)  For  maximum  detection  of  conditions  which  will  adversely 
affect  the  conduct  of  maintenance  operations  or  generate  excessive  mainte¬ 
nance  and  supply  requirements. 

(f)  To  achieve  maximum  compatibility  of  maintenance  operations 
with  common  tools  and  test  measurement,  and  diagnostic  equipment  (TMDE) . 

(g)  To  enable  removal  of  major  components  as  individual  units  and 
when  feasible,  to  use  standardized  components  which  are  compatible  with 
similar  equipment  already  in  the  military  system. 

(h)  To  facilitate  cleaning.  Report  adverse  effects  of  steam 
cleaning  if  this  method  of  cleaning  is  appropriate. 

(i)  To  insure  equipment  is  not  easily  damaged  when  subjected  to 
abnormal  operations,  abuses,  or  overloads  for  short  periods  of  time. 

(j)  Adequacy  of  marking  of  test  points,  circuits,  and  connectors. 

(2)  Interview  mechanics  after  each  maintenance  action;  evaluate 
and  record  the  following: 

(a)  Adequacy  of  hoisting,  lifting,  and  towing  provisions  required 
for  maintenance. 

(b)  Ease  of  maintenance  tasks. 

(c)  Physical  effort  required  for  performing  maintenance. 

(d)  Adequacy  of  working  space  for  performing  maintenance. 

(e)  Simplicity  in  servicing  and  performing  maintenance  duties. 
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(f)  Adequacy  of  hazard  warning  labels. 

(g)  Protection  of  personnel  from  high  voltage  and  shock  hazards. 

(h)  Effects  of  engine  fumes  on  mechanics  during  maintenance. 

(i)  Freedom  from  maintenance  hazards  which  are  induced  by  poor 

design. 

(j)  Servicing  factors  such  as  lubrication  of  equipment,  replen¬ 
ishing  tanks  and  reservoirs. 

(k)  Whether  standard  parts  and  tools  are  used. 

(l)  Adequacy  of  system  and  personal  protective  devices. 

(m)  Comments  and  recommendations  for  improvement. 

b.  Analysis.  All  data  collected  in  sections  5.1.1a  and  5.1.2a  above 
reflect  on  the  design  of  the  test  system  for  maintainability.  These  data 
must  be  integrated  into  a  unified  assessment  of  the  characteristics  of  the 
test  system  to  be  maintained  in  accordance  with  the  TOP  or  other  controlling 
documents. 

5.2  Supply  Support.  Supply  support  data  are  required  to  determine  the 
overal 1  1 ogi Stic  supportabi 1 i ty  of  the  test  item/system.  The  substitution 
of  unauthorized  repair  parts  is  not  authorized.  Supply  data  generated 
during  the  development  test,  particularly  parts  consumption  data,  will 
assist  logistic  personnel  to  determine  the  required  logistic  support  for  the 
test  item/system.  Turn  around  time  (time  to  requisition  and  receive  parts) 
must  be  realistic  based  on  distance  between  supply  points  and  transportation 
availability. 

5.2.1  Data  Required.  Throughout  the  test,  do  the  following  and  record 
appropriate  data,  as  requi red : 

a.  For  each  maintenance  action,  examine  all  replacement  parts  to 

determine  interchangeability.  / 

b.  Assess  repair  parts  design  for  ease  of  installation,  alignment, 
and  checkout. 

c.  Evaluate  nonstandard  parts  to  determine  if  they  can  be  replaced 
with  standard  items  already  in  the  logistic  system. 

d.  Examine  the  battery  and  insure  it  is  one  already  in  the  Army 
system. 
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e.  Examine  repair  parts  with  respect  to  the  prescribed  maintenance 
category  authorized  to  stock  and/or  requisition  the  items.  Repair  p^ts 
authorized  at  each  maintenance  level  should  be  consistent  with  the  authoriz¬ 
ation  of  tools  and  equipment  to  accomplish  the  repair  action. 

f.  Examine  repair  parts  to  evaluate  modular  design  criteria. 

g.  Compare  repair  parts  with  parts  manuals  to  determine  if  data  in 
the  parts  manual  are  adequate  for  identification  and  requisition  by  logistic 
personnel  in  the  field.  For  instance,  is  part  number  or  national  stock- 
number  (NSN)  assigned? 

h.  Complete  a  supply  support  chart  in  accordance  with  TECOM  Supple¬ 
ment  1  to  AMC  Regulation  700-15^  for  each  maintenance  action. 

i.  Check  repair  parts  to  insure  they  are  properly  packaged  and  mark¬ 
ed/identified:  Are  there  any  special  handling  requirements  (static/frag¬ 
ile/cold  or  heat  sensitive). 

5.2.2  Analysis.  Assess  the  impact  of  each  supply  support  anomaly  un¬ 
covered  in  relation  to  the  test  item.  Include  comments  as  to  the  qualita¬ 
tive  effects  of  supply  support  inadequacies  on  the  maintenance  indices 
calculations,  paragraph  5.1.1  above. 

5.3  Technical  Data/Equipment  Publications.  The  subtest  is  conducted  to 
insure  that  the  test  item  technical  data /equipment  publications  are  technic¬ 
ally  adequate,  complete,  and  easily  understood  by  the  maintenance  personnel 
for  whom  they  are  intended.  Each  manual  must  be  evaluated  at  the  approp¬ 
riate  maintenance  level  for  compliance  with  the  military  specification  and 
standards  prescribing  format,  technical  content  and  standards  of  production 
(MIL-M-38784B11).  Comments,  as  appropriate,  will  be  made  (by  separate 
correspondence  or  by  EPR)  to  the  preparing  agency  with  information  copies  to 
the  AMC  Materiel  Readiness  Support  Activity  and  appropriate  US  Army  Training 
and  Doctrine  Command  (TRAD0C)  agencies.  TOP  1-2-609^  (IMAGES),  provides  a 
repeatable,  systematic,  and  quantifiable  method  for  analyzing  technical 
data/equipment  publications.  Special  emphasis  will  be  placed  on  that 
section  of  the  technical  data/equipment  publications  pertaining  to  operation 
under  unusual  conditions  cold, 

5.3.1  Data  Required.  Each  maintenance  action  performed  during  the  test 
will  be  done  in  accordance  with  specific  procedures  provided  in  the  appro¬ 
priate  publication.  All  test  item  operations  and  inspections  will  be  con¬ 
ducted  IAW  the  specific  procedures  provided  in  the  appropriate  publication. 
Complete  the  technical  data/equipment  publication  chart  in  accordance  with 
TECOM  Supplement  1  to  AMC  Regulation  700-15. 
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5.3.2  Analysis.  Evaluate  the  technical  data/equipment  publications 
subjectively  and  quantitatively.  As  a  minimum,  address  the  following 
issues: 


a.  Simplicity,  clarity,  and  completeness  of  the  manuals  commensurate 
with  the  training  and  skills  of  the  targeted  operational  and  maintenance 
personnel . 

b.  Adequacy  and  completeness  of  troubleshooting  instructions. 

c.  Adequacy  and  completeness  of  the  preventive  maintenance  procedures 
to  include  proper  "warmup"  procedures  before  test  item  use. 

d.  Adequacy  and  completeness  of  safety  instructions  to  nersonnel  and 
equipment. 


e.  Adequacy  and  completeness  of  environmental  protection  instructions 
during  operation  and  maintenance  actions. 

f.  Adequacy  and  completeness  of  block  diagrams,  schematics,  and/or 
other  servicing  charts.  Identify  test  points  and  correct  measurements  at 
these  points  to  aid  in  troubleshooting  procedures. 

g.  Adequacy  and  completeness  of  transport,  handling,  and  packaging 
instructions. 

h.  Adequacy  of  instruction  commensurate  with  the  level  of  skill  and 
previous  training  of  the  operational  and  maintenance  personnel.  Identify 
additional  or  special  training  requirements  and  inadequacies  pertaining  to 
cold  weather  operation  and  maintenance. 

i.  Inadequacies  or  suggested  improvements  to  equipment  publications 

will  be  reported  on  DA  Form  2028  or  IMAGES  forms,  if  IMAGES  are  used. 

5.4  Support  and  Test  Equipment.  This  subelement  of  the  Logistic  Support- 
ability  Test  is  conducted  to  determine  the  adequacy  of  the  support  and  test 
equipment  provided  in  the  system  support  package.  All  maintenance  performed 
on  the  test  item  will  be  accomplished  using  the  test  and  support  equipment 
provided  in  the  system  support  package.  If  non-standard  TMDE  is  used,  it 
should  be  subjected  to  the  same  test  criteria  identified  above. 

5.4.1  Data  Required 

a.  For  each  maintenance  action,  complete  the  Support  and  Test  Equip¬ 
ment  Chart  in  accordance  with  TECOM  Supplement  1  to  AMC  Regulation  700-15  , 

and  record  the  following: 

(1)  Maintenance  category  prescribed  and  recommended  for  use  of 
each  item  of  support  and  test  equipment. 
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(2)  Comments  on  adequacy  of  support  (tool  kits  and  special  tools 
found  in  the  system  support  package  listing)  and  test  equipment  for  intended 
use. 


(3)  Comments  on  adequacy  of  printed  instructions  for  use  of 
support  and  test  equipment. 

(4)  Comments  on  whether  the  support  and  test  equipment  are  ex¬ 
cessive  or  could  be  replaced  with  common  items. 

b.  Identify  any  support  and  test  equipment  needed  but  not  available 
in  the  system  support  package. 

c.  Identify  any  problems  associated  with  the  use  of  common  support 
and  test  equipment,  during  maintenance  or  checkout  of  the  test  item/system. 

5.4.2  Analysis.  Discuss  any  problems  associated  with  the  use  of  common 
support  and  test  equipment  with  respect  to  the  test  item/ system. 

5.5  Personnel,  Training,  and  Training  Devices.  This  subelement  of  the 
Logistic  Supportability Test  is  designed  to  evaluate  the  overall  interfaces 
between  the  personnel,  training  and  equipment  required  to  maintain  and 
operate  the  test  item/system.  The  training  devices  addressed  in  this  sub¬ 
element.  are  those  provided  in  the  system  support  package. 

5.5.1  Data  Required.  Issues  to  be  addressed  within  this  subelement 
should  be  available  in  the  Test  Design  Plan  (TDP),  Independent  Evaluation 
Plan  (IEP),  or  other  controlling  document.  If  specific  data  requirements 
are  not  available,  the  following  data  elements  should  be  addressed: 

-  Adequacy  of  the  number  of  personnel  projected  in  the  maintenance 
concept  required  to  logistically  support  the  test  item. 

-  Appropriateness  of  the  MOS  and  skill  level  of  the  prescribed 

personnel . 


-  Adequacy  of  personnel  training  to  perform  the  logistic  support- 
ability  function. 

-  Adequacy  of  the  training  devices  to  accomplish  the  training 
mission  in  support  of  the  logistic  supportability  function. 

13 

TOP  7-3-501  entitled  "Personnel  Training,"  addresses  each  of  the  above 
issues  and  should  be  utilized  as  appropriate. 

5.5.2  Analysis 

12 

a.  Analyze  the  data  recorded  in  compliance  with  TOP  7-3-501  and 
address  the  following  issues  in  the  test  report: 
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(1)  Methods  used  to  train,  update,  and  familiarize  test  personnel 
with  the  test  item/system,  as  related  to  the  training  planned  for  the  field 
operation. 

(2)  Suitability  of  training  documents. 

(3)  Maintenance  level,  MOS,  skill  level,  and  number  of  personnel 
projected  for  each  major  maintenance  task. 

(4)  Additional  training  requirements  identified  during  test 

conduct. 

(5)  Effectiveness  of  training  in  terms  of: 

-  Meeting  all  training  requirements. 

-  Trainees'  ability  to  comprehend  and  effectively  perform  the 
required  instructions/maintenance  tasks. 

-  Number  of  times  trainee  needed  assistance  from  higher  mainte¬ 
nance  level  or  contractor  personnel  and  why. 

b.  Identify  any  incident/accident  which  resulted  from  a  lack  of 
training.  Determine  potential  seriousness  and  suggest  corrective  actions. 

5.6  Transportation  and  Handling.  This  subelement  of  the  Logistic  Support- 
ability  Test  addresses  the  adequacy  of  the  procedures  and  hardware  provided 
for  transport  of  the  test  system  in  a  nonmission-performing  mode.  This 
implies  handling  the  test  system  in  accordance  with  its  transportability 
scenario  (e.g.,  on-load/off-load  and  transport  of  the  item  by  government  or 
commercial  carriers  utilizing  appropriate  handling  components).  This  sub¬ 
element  is  not  normally  evaluated  as  it  is  not  usually  cold-weather  related. 
The  cold  weather  considerations  deal  with  the  adequacy  of  the  new  equipment 
packing.-and  packaging  to  include  repair  parts  and  RPSTL  items.  TOP 
l-2-5o01,3  should  be  used  as  a  guide  in  the  conduct  of  testing. 

5.6.1  Data  Required.  Test  issues  and  data  required  to  evaluate  the 
transportability  and  handling  characteristics  of  the  test  item/ system  should 
be  available  in  the  TDP,  IEP  or  other  controlling  documents.  However,  if 

specific  guidance  is  not  available  and  other  test  agencies  will  not  be 
testing  the  same  item,  the  following  data,  if  collected  and  evaluated,  will 
generally  satisfy  this  subtest. 

a.  Physical  characteristics  to  Include: 

(1)  Physical  description  to  Include  basic  envelope  dimensions 
(length,  width,  height)  for  each  component  or  group  of  components  packaged 
together  (In  the  shipping  configuration)  during  transport.  SSP  Items  are 
Included  In  this  subelement. 
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(2)  Weight  and  cubage  for  each  item/shipping  package. 

(3)  Center  of  gravity  for  each  item/shipping  package. 

(4)  Location  and  handling  limitations  for  each  hard  point  (lift¬ 
ing  and  tie  down  attachments). 

b.  Identify  each  piece  of  equipment  required  to  load  or  unload  the 
test  item. 


c.  Determine  transporter  and  handling  equipment  characteristics: 

(1)  Mode  (air,  rail,  truck,  etc.). 

(2)  Weight  and  handling  limitation  (hard  points,  lifting  and,  tie 
down  attachments). 

(3)  Floor  loading  constraints. 

(4)  Center  of  gravity  envelope  for  cargo  compartment. 

(5)  Loading  ramp  angles  and  crest  angle. 

(6)  For  external  helicopter  transport,  record  the  complete  rig¬ 
ging  setup  (orientation,  attach  points,  tether  length,  swing  envelope)  and 
flight  constraints. 

d.  Record  the  following  data  during  transport  of  the  test  item  in  its 
operational  scenario: 

(1)  Record  of  displacement  (pitch,  yaw,  roll)  of  the  transporter. 

(2)  Record  of  test  item  deflections  correlated  to  transporter 
displacement. 

(3)  Record  of  floor  loading  caused  by  the  test  item  during  trans¬ 
port. 


(4)  Record  critical  clearances  during  loading,  transport  and 
movement.  (Requirement  for  brush  guards,  wire  guards  etc.). 

(5)  Damage  to  test  item  caused  by  loading,  unloading,  or  trans¬ 
porting  the  test  item  as  applicable. 

(6)  Damage  to  transporter  or  handling  equipment  incurred  during 
loading,  unloading,  or  transporting  the  test  item,  as  applicable. 

e.  Prepare  a  loading  diagram  and  record  the  center  of  gravity  of  the 
transporter  loaded  with  the  test  item. 
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f.  Record  the  degree  of  disassembly  required  for  loading  and  trans¬ 
port,  as  required. 

g.  Record  any  special  servicing  or  preparation  of  the  test  item 
required  for  loading  and  transport. 

h.  Record  measurements  of  shock  and  vibration  forces  sustained  by  the 
test  item  during  transport  and  the  adequacy  of  the  new  equipment  packing  and 
packaging  and  how  it  performs  in  the  cold  regions. 

5.6.2  Analysis.  Evaluate  the  data  gathered.  Address  all  criteria 
statements  concerning  transportability.  Qualitatively  address  the  follow¬ 
ing: 


a.  The  ease  or  difficulty  of  loading,  unloading,  and  transport  of  the 
test  item. 


b.  The  adequacy  of  handling  devices  (sling,  spreader  bars,  hooks, 
handles,  etc.). 

c.  Human  factors  engineering  of  the  handling  and  transport  methodol¬ 
ogy. 

d.  Safety  (personnel  and  equipment)  of  the  transportability  method¬ 
ology. 

e.  Mission  impact  resulting  from  test  item  damage  sustained  during 
handling  or  transport  as  applicable. 

f.  Extent  of  preparation,  packing,  and  packaging  of  the  test  item 
prior  to  transport. 

g.  The  relative  ease  or  difficulty  of  converting  from  operational  to 
transport  configuration,  and  back  to  operation,  in  the  required  time  frame. 

h.  Security  of  the  test  item  during  preparation,  transport,  and 
reassembly.  Requirement  for  security  or  COMSEC  equipment  or  other  classi¬ 
fied  components. 

i.  Adequacy  of  special  handling  equipment,  devices,  fixtures,  or 

Jigs. 


5.7  Facilities.  Facilities  are  normally  not  evaluated,  but  If  evaluated 
include  all  physical  assets  (buildings,  maintenance  vans,  fixtures,  runways, 
ranges,  etc.)  and  their  organizational  components  (TDA  structure,  personnel, 
and  equipment)  required  to  accommodate  a  specific  functional  requirement 
germane  to  the  logistic  support  of  the  test  Item/system.  Training  require¬ 
ments  should  not  be  overlooked,  as  well  as  facilities  required  for  storage 
of  repair  parts,  spares,  and  data.  The  materiel  developer  should  provide 
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unique  facility  requirements  for  test  purposes,  e.g.,  a  semimobile  clean 
room,  special  data  processing/ reduction  equipment,  special  test  check¬ 
out/calibration  and  maintenance  equipment,  etc.  This  data,  in  conjunction 
with  the  logistic  support  knowledge  gained  through  test  experience  locally 
and  at  the  contractor  support  level,  will  provide  the  test  officer  some 
insight  into  the  facilities  needed  in  the  field  environment.  As  applicable, 
the  facility  planning  documents  provided  by  the  materiel  developer  should  be 
consulted  and  the  proposed  facilities  evaluated  in  accordance  with  the 
issues,  criteria,  and/or  requirements  included  in  the  IEP  or  TDP. 

5.7.1  Data  Required.  The  logistic  supportability  function  encompasses 
all  support  activities  associated  with  the  operation,  maintenance,  servic¬ 
ing,  storage,  repair  parts  system,  and  training  of  personnel  to  support  the 
test  item/system.  As  a  minimum,  record  the  following  data: 

a.  Instances  where  a  facility  (government,  contract,  or  commercial) 
utilized  during  test  was  inadequate  to  accomplish  the  logistic  support- 
ability  function  for  which  it  was  intended. 

b.  Instances  during  test  where  a  facility's  physical  location  (gov¬ 
ernment,  contractor,  or  commercial)  adversely  affected  the  logistic  support- 
ability  of  the  test  item. 

c.  Instances  where  a  facility's  physical  environment  (temperature, 
ventilation,  contamination,  cleanliness,  electrical  supply,  etc.)  adversely 
affects  the  logistic  supportability  of  the  test  item. 

d.  Instances  where  a  facility's  standard  fixed  equipment  (government, 
contractor,  commercial)  would  not  readily  perform  a  logistic  supportability 
function  for  the  test  item/ system. 

5.7.2  Analysis.  Using  test  data  recorded  above  on  existing  facilities 
and  issues  and  requirements  extracted  from  the  appropriate  requirements 
documents,  qualitatively  assess  whether  the  facilities  projected  are  ade¬ 
quate  for  the  logistic  supportability  function  for  which  they  were  intended. 
As  a  minimum,  address  data  collected  above  and  extrapolate  potential  impact 
on  the  logistic  supportability  facilities  planned  for  the  test  item/system. 
Also  address  the  following: 

a.  Comment  on  whether  all  logistic  supportability  equipment  planned 
for  the  projected  test  item  support  facility  is  required. 

b.  Comment  as  to  whether  the  planned  fixed  equipment  can  be  Installed 
and  operated  In  existing  facilities  without  adversely  affecting  other 
on-going  facility  functions. 

5.8  Stowage.  The  subelement  of  the  logistic  supportability  test  addresses 
the  adequacy  of  the  storage  space  provided  for  basic  Issue  Item  (BII),  troop 
installed  authorized  Items,  and  publications. 
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5.8.1  Data  Required.  Test  issue  and  data  required  to  evaluate  the 
stowage  requirements  should  be  available  in  the  IEP,  TDP,  or  other  control¬ 
ling  documents.  However,  if  specific  guidance  is  not  available,  the  fol¬ 
lowing  data,  if  collected  and  evaluated  will  generally  satisfy  this  subtest. 

a.  Comments  of  drivers,  maintenance  evaluators,  and  test  supervisory 
personnel  pertinent  to  the  adequacy  of  the  space  and  protection  provided  for 
BII,  publications,  and  cold  weather  combat  gear. 

b.  Physical  checks  of  items  in  stowage  for  damage  after  each  type  of 
road  condition  encountered. 

5.8.2  Analysis.  Assess  the  data  gathered.  Address  all  criteria  state¬ 
ments  concerning  stowage.  Qualitatively  addresss  all  problems  with  stowage 
encountered. 

6.  DATA  REDUCTION  AND  PRESENTATION.  Data  reduction/analysis  and  presenta¬ 
tion  will  be  IAW  the  TbP  and  TECbM  Pamphlet  70-3  . 

6.1  Data  Reduction/Analysis.  Data  reduction  in  general  involves  identify¬ 
ing,  correlating,  and  organizing  raw  test  data  into  data  sets  which  can  be 
analyzed  to  form  a  complete  and  comprehensive  picture  of  the  overall  logis¬ 
tic  supportability  of  the  test  item.  Each  test  incident  will  be  analyzed  to 
determine  the  implication/impact,  if  any,  to  each  of  the  logistic  sup- 
portability  subelements  presented  in  paragraph  5,  Performance  Test.  Address 
each  problem/deficiency  cited  in  each  of  the  logistic  supportability  sub¬ 
elements  and  qualitatively  relate  its  impact  on  the  maintenance  indices 
calculated  in  the  end  item  requirements  subelement. 

6.2  Data  Presentation.  Prepare  a  narrative  of  the  test  results  to  include 
diagrams,  photographs,  table,  and  other  reduced  data  as  required,  to  support 
the  test  conclusions  and  recommendations.  Establish  the  degree  to  which  the 
test  item/system  logistic  supportability  satisfies  the  test  criteria. 


Recommended  changes  to  this  publication  should  be  forwarded  to 
Commander,  US  Army  Test  and  Evaluation  Command,  ATTN:  AMSTE-AD-M, 
Aberdeen  Proving  Ground,  MD  21005-5055.  Technical  information 
nay  be  obtained  from  the  preparing  activity:  Commander,  US  Army 
Cold  Regions  Test  Center,  ATTN:  STECR-MTT-A,  AP0  Seattle,  WA 
98733-7850.  Additional  copies  are  available  from  the  Defense 
Technical  Information  Center  (OTIC),  Cameron  Station,  Alexandria, 
VA  22304-6145.  This  document  Is  Identified  by  the  accession 
number  (AD  No.)  printed  on  the  first  page. 
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APPENDIX  A  -  PRETEST  CHECKLIST 


1.  Have  facilities,  test  equipment,  instrumentation,  and  support  require¬ 
ments  been  scheduled  or  secured?  See  paragraph  2  of  this  TOP.  YES 
NO  . 


2.  Has  appropriate  test  planning  been  accomplished  in  accordance  with 

paragraph  3,  this  TOP?  YES _  NO _ . 

3.  Have  test  control  measures  been  implemented  such  that  test  results 
could  be  duplicated  or  compared?  See  paragraph  4,  this  TOP. 

YES  NO 


4.  Have  all  test  personnel  been  briefed  on  the  test  procedures?  YES 
NO 


A-l 


APPENDIX  B  -  POST-TEST  CHECKLIST 


1.  Have  test  data  been  collected,  recorded,  and  presented  in  accordance 
with  this  TOP?  YES  NO  .  Comment: 


2.  Have  all  data  collected  been  reviewed  for  correctness  and  completeness? 
YES  NO  .  Comment: 


3.  Were  the  facilities,  test  equipment,  instrumentation,  and  support 
accommodations  adequate  to  accomplish  the  test  objectives?  YES _  NO _ . 


4.  Were  the  test  results  compromised  in  any  way  due  to  insufficient  test 
planning?  YES _  NO _ .  Comment: _ 


5.  Were  the  test  results  compromised  in  any  way  due  to  test  performance 
procedures?  YES _  NO _ .  Comment: _ 


6.  Were  the  test  results  compromised  in  any  way  due  to  test  control  pro¬ 
cedures?  YES  NO  Comment:  _ 


7.  Were  the  test  results  compromised  in  any  way  due  to  data  collection, 
reduction,  or  presentation?  YES _  NO _ .  Comment: _ 
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APPENDIX  C  -  END  OF  MAINTENANCE  ACTION  QUESTIONNAIRE 

Name _  Rank _  Date _ 

(last)  (first) 


Unit  MOS 


Question  1. 

a.  Are  hoisting,  lifting,  and  towing  facilities  adequate  to  maintain 
the  test  item? 


_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

b.  Comments: 


Question  2.  The  following  questions  pertains  to  equipment  publications 

a.  Were  the  publications  complete? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

b.  Comments: 
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c.  Were  the  publications  accurate? 


_6  -  Extremely  Accurate 
~5  -  Very  Accurate 
-  Accurate 

'3  -  Accurate  at  Times 
”2  -  Very  Inaccurate 
"1  -  Extremely  Inaccurate 


Comments: 


e.  Were  the  publications  easy  to  read? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 

f.  Comments: 


g.  Were  the  publications  easy  to  follow? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 

h.  Comments: 


C-2 
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i.  Adequate  instructions  to  complete  maintenance  actions? 


6  -  Extremely  Adequate 
5  -  Very  Adequate 
4  -  Adequate 
3  -  Adequate  at  Times 
2  -  Very  Inadequate 
1  -  Extremely  Inadequate 


j .  Comments : 


k.  Adequate  instructions  for  part  requisitioning? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

l.  Comments:  _ 


Question  3.  Did  you  encounter  any  difficulties  performing  the  maintenance 
action  in  any  of  the  following  areas? 

a.  Maintenance  operations? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 

b.  Comments:  _  _ _ 
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c.  Working  space? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

d.  Comments: 


e.  Use  of  tools  and  test  equipment? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

f.  Comments:  _ 


g.  Changing  replaceable  components  (such  as  filters,  belts,  etc.? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 

h.  Comments:  _ _ 


C-4 


\ 


20  June  1985  TOP  6 

i.  Lubrication^ replenishing  tanks  and  reservoirs,  etc.? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 
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APPENDIX  D  -  NUMERICAL  ANALYSIS  OF  MAINTAINABILITY  INDICES 

I.  OUTLINE:  The  following  outline  is  a  chronological  procedure  for  doing 
a  maintainability  numerical  analysis.  Discussion  to  follow  at  paragraph  II. 

A.  Compute  the  following  indices: 

1.  MTTR  (point  estimate). 

2.  Availability: 

a.  Inherent  (Ai). 

b.  Achieved  (Aa). 

c.  Operational  (Ao). 

3.  Maintenance  Ratio  (MR). 

B.  Special  Topics,  As  Required. 

II.  DISCUSSION: 

A.  Maintenance  Indices. 

1.  Mean-time-to-repair  (MTTR) :  The  MTTR  is  that  ratio  of  the 
time  it  takes  at  a  specific  level  of  maintenance,  (crew,  organizational, 
direct  support)  to  repair  the  test  item.  MTTR  can  also  be  calculated  as  an 
overall  ratio  for  repair  of  the  test  item.  When  examining  the  data  that  are 
used  in  the  calculations  screen  the  excessive  maintenance  times  and  explain 
the  reasons  why  they  were  excessive  (i.e.  inadequate  equipment  publications, 
poor  design,  etc.).  Calculate  the  MTTR  using  all  the  data  and  then  with  the 
excessive  time  removed.  The  MTTR  estimates  of  the  maintenance  time  will 
depict  what  can  be  expected  when  the  problem  areas  are  corrected. 

2.  Availability.  The  availability  of  a  system  or  equipment  is 
the  probability  that  it  is  fully  operational  at  any  point  in  time  when 
operated  and  maintained  under  stated  conditions.  This  maintainability  index 
is  widely  used  in  the  armed  services  as  well  as  industry,  and  is  usually 
stated  in  terms  of  design  requirement,  or  operational  use.  Associated  terms 
are  (1)  Inherent  availability  (Ai),  the  design  standard;  (2)  Achieved 
Availability  (Aa),  actual  test  experience;  (3)  Operational  Availability 
(Ao),  actual  field  operational  environment. 

a.  Ai  (Inherent  Availability): 

Ai  =  0T 

0T  +  TDM 
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Where:  OT  =  The  operating  time  during  a  stated  period. 

TUM  =  Total  unscheduled  active  maintenance  time  in  clock-hours 
during  the  stated  period. 

As  can  be  seen  from  the  equation,  standby  time  (ST),  scheduled  maintenance 
time  (PMT),  and  administrative  logistics  delay  time  (ALDT)  do  not  enter  into 
the  equation. 

b.  Aa  (Achieved  Availability):  Achieved  availability  is  that 
ratio  of  the  operational  time  to  maintenance  down  time  experienced  during 
test.  TUM,  ST,  PMT,  and  ALDT  are  used  in  the  availability  computations  only 
when  a  mission-essential  function  is  lost.  Aa  is  defined  as  follows: 

Aa  =  OT 

OT  +  SMT  +  TUM 

Again,  standby  time  (ST)  and  administrative  logistics  delay  time  (ALDT)  do 
not  enter  the  equation;  however,  scheduled  maintenance  time  (SMT)  is  con¬ 
sidered.  Ordinarily,  ST  and  ALDT  are  not  very  useful  in  the  developmental 
test  environment. 

c.  Ao  (Operational  Availability):  Operational  availability  re¬ 
flects  the  best  estimate  of  the  true  availability  ratio  for  a  test  item  when 
calculated  utilizing  data  obtained  from  the  real  operational  environment. 
Operational  availability  reflects  all  of  the  subelements  for  calculating 
availability  and  can  be  summarized  as  the  ratio  of  uptime  divided  by  down¬ 
time.  More  explicitly,  operational  availability  is  defined  as  follows: 

Ao  =  ST  +  OT 

ST  +  OT  +  SMT  +  TUM  +  ALDT 

In  accordance  with  TECOM  Supplement  1  to  AMC  Regulation  700-157,  cases 
where  Ao  is  required  and  in  cases  where  downtime  for  ALDT  factors  is  not 
provided  in  the  IEP/TDP  for  calculating  Ao,  the  instal lation/field  operating 
activity  will  estimate  these  items  based  on  expert  judgment  and  military 
experience. 

3.  MR  (Maintenance  Ratio).  The  maintenance  ratio  is  the  total 
maintenance  (scheduled  (preventative) ,  and  unscheduled  (corrective)) 
man-hours  divided  by  the  total  operating  time.  The  MR  is  expressed  as 
follows: 


MR  =  SMT  +  TUM 

6 

B.  SPECIAL  TOPICS:  AMC  Pamphlet  706-113  presents  some  experi¬ 
mental  statistical  techniques  of  special  interest  to  the  developmental 
tester.  Chapters  15  and  16  present  techniques  for  comparing  the  performance 
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of  a  new  product/system  to  that  of  a  standard.  Chapter  17  presents  the 
treatment  of  outliners  and  Chapter  21  presents  the  relation  between  confi¬ 
dence  intervals  and  tests  of  significance.  Specific  examples  are  provided 
in  the  AMCP  to  illustrate  each  statistical  technique. 
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